Each score pertains to the combined test set of the language, without distinguishing individual treebanks and the enhancement types they annotate. The last line shows the macro-average over languages.
Language | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS |
Arabic | 99.98 | 94.58 | 82.09 | 91.73 | 89.14 | 89.27 | 88.89 | 90.53 | 78.48 | 74.61 | 71.43 | 66.00 | 68.11 | 58.76 | 57.19 |
Bulgarian | 99.91 | 99.91 | 94.17 | 99.13 | 97.34 | 98.02 | 96.85 | 98.15 | 93.81 | 91.19 | 88.43 | 85.36 | 86.06 | 77.95 | 77.29 |
Czech | 98.70 | 98.70 | 70.99 | 96.02 | 90.07 | 90.56 | 88.68 | 96.15 | 86.37 | 83.47 | 82.29 | 73.70 | 80.07 | 68.15 | 66.41 |
Dutch | 99.74 | 99.74 | 69.26 | 96.97 | 95.81 | 96.87 | 95.23 | 97.30 | 88.16 | 85.70 | 80.18 | 76.11 | 77.63 | 68.36 | 67.67 |
English | 99.22 | 99.22 | 83.82 | 95.98 | 95.29 | 96.04 | 93.50 | 96.79 | 88.03 | 85.68 | 83.02 | 77.42 | 80.57 | 71.01 | 70.44 |
Estonian | 99.70 | 99.70 | 89.98 | 97.07 | 97.77 | 95.80 | 94.44 | 95.12 | 86.78 | 84.01 | 82.60 | 77.65 | 77.64 | 75.33 | 61.12 |
Finnish | 99.70 | 99.68 | 88.65 | 97.91 | 56.17 | 96.65 | 54.56 | 92.49 | 90.90 | 89.03 | 87.76 | 83.77 | 79.46 | 73.51 | 72.37 |
French | 99.65 | 99.23 | 94.35 | 95.18 | 74.50 | 76.92 | 55.45 | 96.59 | 91.00 | 86.55 | 82.39 | 50.16 | 79.09 | 75.93 | 74.74 |
Italian | 99.93 | 99.84 | 98.76 | 98.45 | 98.32 | 98.28 | 97.64 | 98.68 | 93.90 | 92.20 | 88.53 | 85.93 | 87.08 | 72.80 | 71.98 |
Latvian | 99.33 | 99.33 | 98.74 | 96.50 | 90.03 | 94.18 | 89.45 | 96.13 | 89.32 | 86.45 | 84.40 | 76.90 | 81.13 | 73.03 | 72.41 |
Lithuanian | 99.91 | 99.91 | 87.87 | 93.92 | 85.97 | 87.01 | 84.74 | 92.26 | 76.72 | 72.10 | 69.87 | 58.39 | 64.32 | 60.37 | 58.36 |
Polish | 98.63 | 99.30 | 86.27 | 97.37 | 88.96 | 82.68 | 77.08 | 97.23 | 89.53 | 85.90 | 84.34 | 64.33 | 82.14 | 70.85 | 65.86 |
Russian | 99.60 | 99.60 | 98.80 | 98.76 | 99.60 | 97.42 | 97.19 | 98.23 | 93.50 | 92.16 | 90.85 | 88.15 | 89.26 | 76.02 | 75.27 |
Slovak | 100.00 | 100.00 | 85.28 | 97.37 | 88.06 | 92.81 | 87.07 | 96.88 | 90.90 | 88.84 | 87.33 | 77.89 | 83.84 | 71.02 | 68.43 |
Swedish | 99.18 | 99.18 | 93.54 | 97.09 | 95.77 | 89.03 | 87.97 | 93.31 | 88.11 | 85.32 | 83.72 | 69.88 | 77.72 | 69.42 | 68.39 |
Tamil | 99.16 | 94.51 | 97.52 | 82.67 | 73.06 | 77.36 | 72.05 | 88.24 | 67.09 | 59.25 | 55.11 | 44.25 | 51.85 | 50.12 | 48.47 |
Ukrainian | 99.85 | 99.81 | 96.61 | 97.86 | 94.24 | 94.20 | 93.26 | 97.64 | 89.50 | 87.08 | 84.26 | 77.82 | 81.96 | 67.55 | 66.43 |
Average | 99.54 | 98.96 | 89.22 | 95.88 | 88.83 | 91.36 | 85.53 | 95.40 | 87.18 | 84.09 | 81.56 | 72.57 | 78.11 | 69.42 | 67.23 |
The system output for each language was split into parts corresponding to individual source treebanks. The scores then ignore errors in enhancement types for which the treebank lacks gold-standard annotation. The column LAvgELAS shows the qualitative ELAS averaged over treebanks of the same language; the final average in bold is averaged over languages rather than treebanks. For comparison, the last column then shows the coarse ELAS F1 for the given language.
Treebank | Tokens | Words | Sentences | UPOS | XPOS | UFeats | AllTags | Lemmas | UAS | LAS | CLAS | MLAS | BLEX | EULAS | ELAS | Enhancements | LAvgELAS | cf. |
Arabic-PADT | 99.98 | 94.58 | 82.09 | 91.73 | 89.14 | 89.27 | 88.89 | 90.53 | 78.48 | 74.61 | 71.43 | 66.00 | 68.11 | 58.77 | 57.19 | (no xsubj) | 57.19 | 57.19 |
Bulgarian-BTB | 99.91 | 99.91 | 94.17 | 99.13 | 97.34 | 98.02 | 96.85 | 98.15 | 93.81 | 91.19 | 88.43 | 85.36 | 86.06 | 77.95 | 77.29 | 77.29 | 77.29 | |
Czech-FicTree | 99.82 | 99.78 | 57.98 | 96.27 | 76.34 | 79.42 | 72.27 | 96.86 | 87.91 | 84.93 | 83.82 | 55.64 | 80.62 | 71.91 | 70.04 | 68.01 | 66.41 | |
Czech-CAC | 99.99 | 99.98 | 99.76 | 99.42 | 96.78 | 96.52 | 96.18 | 98.76 | 93.34 | 91.42 | 89.68 | 85.41 | 88.30 | 73.28 | 71.72 | 68.01 | 66.41 | |
Czech-PDT | 98.55 | 98.56 | 69.49 | 95.95 | 91.05 | 91.31 | 89.89 | 96.02 | 85.81 | 83.05 | 82.05 | 74.88 | 79.88 | 67.67 | 65.94 | 68.01 | 66.41 | |
Czech-PUD | 98.28 | 98.28 | 86.15 | 94.44 | 89.42 | 90.14 | 87.80 | 95.18 | 86.14 | 81.46 | 78.96 | 70.77 | 76.60 | 66.29 | 64.34 | (no codepend) | 68.01 | 66.41 |
Dutch-Alpino | 99.83 | 99.83 | 88.59 | 97.42 | 96.39 | 97.49 | 95.87 | 97.44 | 91.53 | 89.10 | 84.75 | 81.04 | 81.77 | 72.12 | 71.44 | 67.73 | 67.67 | |
Dutch-LassySmall | 99.65 | 99.65 | 53.62 | 96.54 | 95.25 | 96.29 | 94.63 | 97.16 | 84.93 | 82.44 | 75.95 | 71.55 | 73.79 | 64.72 | 64.03 | 67.73 | 67.67 | |
English-EWT | 98.90 | 98.90 | 77.40 | 95.87 | 95.58 | 96.32 | 94.44 | 97.37 | 86.72 | 84.42 | 81.37 | 77.35 | 79.97 | 71.10 | 70.61 | 70.43 | 70.44 | |
English-PUD | 99.59 | 99.59 | 96.00 | 96.12 | 94.95 | 95.72 | 92.37 | 96.11 | 89.59 | 87.17 | 85.10 | 77.51 | 81.32 | 70.92 | 70.25 | 70.43 | 70.44 | |
Estonian-EDT | 99.96 | 99.96 | 91.56 | 97.58 | 98.24 | 96.36 | 95.15 | 95.50 | 87.92 | 85.26 | 83.83 | 79.22 | 78.93 | 76.93 | 62.29 | (no xsubj) | 59.00 | 61.12 |
Estonian-EWT | 98.48 | 98.48 | 80.46 | 94.60 | 95.53 | 93.14 | 91.03 | 93.32 | 81.32 | 78.06 | 76.62 | 70.02 | 71.35 | 67.93 | 55.70 | (no codepend, no xsubj) | 59.00 | 61.12 |
Finnish-TDT | 99.71 | 99.70 | 88.64 | 97.75 | 98.31 | 96.33 | 95.48 | 92.42 | 90.31 | 88.41 | 87.24 | 83.00 | 78.88 | 74.12 | 73.02 | 72.30 | 72.37 | |
Finnish-PUD | 99.67 | 99.66 | 88.66 | 98.12 | 0.00 | 97.08 | 0.00 | 92.57 | 91.69 | 89.86 | 88.45 | 84.78 | 80.22 | 72.78 | 71.58 | (no codepend, no xsubj) | 72.30 | 72.37 |
French-Sequoia | 99.79 | 99.09 | 87.50 | 96.94 | 73.40 | 81.05 | 58.08 | 96.97 | 88.14 | 85.41 | 83.84 | 57.17 | 81.31 | 77.89 | 77.44 | (no gapping, relcl, case) | 75.87 | 74.74 |
French-FQB | 99.59 | 99.30 | 95.67 | 94.45 | 74.97 | 75.19 | 54.36 | 96.43 | 92.19 | 87.03 | 81.79 | 47.25 | 78.18 | 74.96 | 74.30 | (no gapping, relcl, case) | 75.87 | 74.74 |
Italian-ISDT | 99.93 | 99.84 | 98.76 | 98.45 | 98.32 | 98.28 | 97.64 | 98.68 | 93.90 | 92.20 | 88.53 | 85.93 | 87.08 | 72.80 | 71.98 | 71.98 | 71.98 | |
Latvian-LVTB | 99.33 | 99.33 | 98.74 | 96.50 | 90.03 | 94.18 | 89.45 | 96.13 | 89.32 | 86.45 | 84.40 | 76.90 | 81.13 | 73.03 | 72.41 | 72.41 | 72.41 | |
Lithuanian-ALKSNIS | 99.91 | 99.91 | 87.87 | 93.92 | 85.97 | 87.01 | 84.74 | 92.26 | 76.72 | 72.10 | 69.87 | 58.39 | 64.32 | 60.37 | 58.36 | 58.36 | 58.36 | |
Polish-LFG | 99.85 | 99.85 | 99.65 | 98.58 | 90.08 | 84.64 | 78.25 | 98.16 | 95.08 | 91.91 | 90.39 | 70.70 | 88.48 | 74.55 | 61.23 | (no gapping) | 64.85 | 65.86 |
Polish-PDB | 98.38 | 99.48 | 79.98 | 97.64 | 89.41 | 83.32 | 77.92 | 97.58 | 88.53 | 84.92 | 83.46 | 63.99 | 81.55 | 70.65 | 67.68 | 64.85 | 65.86 | |
Polish-PUD | 98.20 | 98.59 | 78.67 | 96.00 | 87.33 | 80.11 | 74.72 | 95.92 | 87.41 | 83.40 | 81.76 | 60.58 | 78.86 | 68.76 | 65.64 | 64.85 | 65.86 | |
Russian-SynTagRus | 99.60 | 99.60 | 98.80 | 98.76 | 99.60 | 97.42 | 97.19 | 98.23 | 93.50 | 92.16 | 90.85 | 88.15 | 89.26 | 76.02 | 75.27 | 75.27 | 75.27 | |
Slovak-SNK | 100.00 | 100.00 | 85.28 | 97.37 | 88.06 | 92.81 | 87.07 | 96.88 | 90.90 | 88.84 | 87.33 | 77.89 | 83.84 | 71.02 | 68.43 | 68.43 | 68.43 | |
Swedish-Talbanken | 99.89 | 99.89 | 96.13 | 98.42 | 97.45 | 97.56 | 96.77 | 98.14 | 91.04 | 88.67 | 86.96 | 83.22 | 84.89 | 72.87 | 71.86 | 68.28 | 68.39 | |
Swedish-PUD | 98.41 | 98.41 | 90.47 | 95.67 | 93.98 | 79.88 | 78.53 | 88.12 | 84.98 | 81.72 | 80.25 | 55.61 | 70.05 | 65.76 | 64.70 | 68.28 | 68.39 | |
Tamil-TTB | 99.16 | 94.51 | 97.52 | 82.67 | 73.06 | 77.36 | 72.05 | 88.24 | 67.09 | 59.25 | 55.11 | 44.25 | 51.85 | 50.12 | 48.47 | (no gapping, xsubj, relcl) | 48.47 | 48.47 |
Ukrainian-IU | 99.85 | 99.81 | 96.61 | 97.86 | 94.24 | 94.20 | 93.26 | 97.64 | 89.50 | 87.08 | 84.26 | 77.82 | 81.96 | 67.55 | 66.43 | 66.43 | 66.43 | |
Average | 99.44 | 99.09 | 87.37 | 96.22 | 87.51 | 90.59 | 83.25 | 95.60 | 87.78 | 84.73 | 82.37 | 71.80 | 78.88 | 70.10 | 67.49 | 67.19 |